Modifying digital images utilizing auto focus information

ABSTRACT

A method of processing a digital image comprising: capturing the image utilizing an adjustable focusing technique; utilizing the focusing settings as an indicator of the position of structures within the image; and processing the image, utilizing the said focus settings to produce effects specific to said focus settings.

CROSS REFERENCES TO RELATED APPLICATIONS

[0001] The following Australian provisional patent applications arehereby incorporated by reference. For the purposes of location andidentification, US patents/patent applications identified by their USpatent/patent application serial numbers are listed alongside theAustralian applications from which the US patents/patent applicationsclaim the right of priority. US PATENT/PATENT CROSS-REFERENCEDAPPLICATION (CLAIMING AUSTRALIAN RIGHT OF PRIORITY FROM PROVISIONALPATENT AUSTRALIAN PROVISIONAL DOCKET APPLICATION NO. APPLICATION) NO.PO7991 09/113,060 ART01 PO8505 09/113,070 ART02 PO7988 09/113,073 ART03PO9395 6,322,181 ART04 PO8017 09/112,747 ART06 PO8014 09/112,776 ART07PO8025 09/112,750 ART08 PO8032 09/112,746 ART09 PO7999 09/112,743 ART10PO7998 09/112,742 ART11 PO8031 09/112,741 ART12 PO8030 6,196,541 ART13PO7997 6,195,150 ART15 PO7979 09/113,053 ART16 PO8015 09/112,738 ART17PO7978 09/113,067 ART18 PO7982 09/113,063 ART19 PO7989 09/113,069 ART20PO8019 09/112,744 ART21 PO7980 6,356,715 ART22 PO8018 09/112,777 ART24PO7938 09/113,224 ART25 PO8016 6,366,693 ART26 PO8024 09/112,805 ART27PO7940 09/113,072 ART28 PO7939 09/112,785 ART29 PO8501 6,137,500 ART30PO8500 09/112,796 ART31 PO7987 09/113,071 ART32 PO8022 09/112,824 ART33PO8497 09/113,090 ART34 PO8020 09/112,823 ART38 PO8023 09/113,222 ART39PO8504 09/112,786 ART42 PO8000 09/113,051 ART43 PO7977 09/112,782 ART44PO7934 09/113,056 ART45 PO7990 09/113,059 ART46 PO8499 09/113,091 ART47PO8502 6,381,361 ART48 PO7981 6,317,192 ART50 PO7986 09/113,057 ART51PO7983 09/113,054 ART52 PO8026 09/112,752 ART53 PO8027 09/112,759 ART54PO8028 09/112,757 ART56 PO9394 6,357,135 ART57 PO9396 09/113,107 ART58PO9397 6,271,931 ART59 PO9398 6,353,772 ART60 PO9399 6,106,147 ART61PO9400 09/112,790 ART62 PO9401 6,304,291 ART63 PO9402 09/112,788 ART64PO9403 6,305,770 ART65 PO9405 6,289,262 ART66 PP0959 6,315,200 ART68PP1397 6,217,165 ART69 PP2370 09/112,781 DOT01 PP2371 09/113,052 DOT02PO8003 6,350,023 Fluid01 PO8005 6,318,849 Fluid02 PO9404 09/113,101Fluid03 PO8066 6,227,652 IJ01 PO8072 6,213,588 IJ02 PO8040 6,213,589IJ03 PO8071 6,231,163 IJ04 PO8047 6,247,795 IJ05 PO8035 6,394,581 IJ06PO8044 6,244,691 IJ07 PO8063 6,257,704 IJ08 PO8057 6,416,168 IJ09 PO80566,220,694 IJ10 PO8069 6,257,705 IJ11 PO8049 6,247,794 IJ12 PO80366,234,610 IJ13 PO8048 6,247,793 IJ14 PO8070 6,264,306 IJ15 PO80676,241,342 IJ16 PO8001 6,247,792 IJ17 PO8038 6,264,307 IJ18 PO80336,254,220 IJ19 PO8002 6,234,611 IJ20 PO8068 6,302,528 IJ21 PO80626,283,582 IJ22 PO8034 6,239,821 IJ23 PO8039 6,338,547 IJ24 PO80416,247,796 IJ25 PO8004 09/113,122 IJ26 PO8037 6,390,603 IJ27 PO80436,362,843 IJ28 PO8042 6,293,653 IJ29 PO8064 6,312,107 IJ30 PO93896,227,653 IJ31 PO9391 6,234,609 IJ32 PP0888 6,238,040 IJ33 PP08916,188,415 IJ34 PP0890 6,227,654 IJ35 PP0873 6,209,989 IJ36 PP09936,247,791 IJ37 PP0890 6,336,710 IJ38 PP1398 6,217,153 IJ39 PP25926,416,167 IJ40 PP2593 6,243,113 IJ41 PP3991 6,283,581 IJ42 PP39876,247,790 IJ43 PP3985 6,260,953 IJ44 PP3983 6,267,469 IJ45 PO79356,224,780 IJM01 PO7936 6,235,212 IJM02 PO7937 6,280,643 IJM03 PO80616,284,147 IJM04 PO8054 6,214,244 IJM05 PO8065 6,071,750 IJM06 PO80556,267,905 IJM07 PO8053 6,251,298 IJM08 PO8078 6,258,285 IJM09 PO79336,225,138 IJM10 PO7950 6,241,904 IJM11 PO7949 09/113,129 IJM12 PO806009/113,124 IJM13 PO8059 6,231,773 IJM14 PO8073 6,190,931 IJM15 PO80766,248,249 IJM16 PO8075 09/113,120 IJM17 PO8079 6,241,906 IJM18 PO805009/113,116 IJM19 PO8052 6,241,905 IJM20 PO7948 09/113,117 IJM21 PO79516,231,772 IJM22 PO8074 6,274,056 IJM23 PO7941 09/113,110 IJM24 PO80776,248,248 IJM25 PO8058 09/113,087 IJM26 PO8051 09/113,074 IJM27 PO80456,110,754 IJM28 PO7952 09/113,088 IJM29 PO8046 09/112,771 IJM30 PO93906,264,849 IJM31 PO9392 6,254,793 IJM32 PP0889 6,235,211 IJM35 PP088709/112,801 IJM36 PP0882 6,264,850 IJM37 PP0874 6,258,284 IJM38 PP139609/113,098 IJM39 PP3989 6,228,668 IJM40 PP2591 6,180,427 IJM41 PP39906,171,875 IJM42 PP3986 6,267,904 IJM43 PP3984 6,245,247 IJM44 PP398209/112,835 IJM45 PP0895 6,231,148 IR01 PP0870 09/113,106 IR02 PP086909/113,105 IR04 PP0887 09/113,104 IR05 PP0885 6,238,033 IR06 PP088409/112,766 IR10 PP0886 6,238,111 IR12 PP0871 09/113,086 IR13 PP087609/113,094 IR14 PP0877 09/112,760 IR16 PP0878 6,196,739 IR17 PP087909/112,774 IR18 PP0883 6,270,182 IR19 PP0880 6,152,619 IR20 PP088109/113,092 IR21 PO8006 6,087,638 MEMS02 PO8007 09/113,093 MEMS03 PO800809/113,062 MEMS04 PO8010 6,041,600 MEMS05 PO8011 09/113,082 MEMS06PO7947 6,067,797 MEMS07 PO7944 09/113,080 MEMS09 PO7946 6,044,646 MEMS10PO9393 09/113,065 MEMS11 PP0875 09/113,078 MEMS12 PP0894 09/113,075MEMS13

FIELD OF THE INVENTION

[0002] The present invention relates to an image processing method andapparatus and, in particular, discloses a process for utilizingautofocus information in a digital image camera.

BACKGROUND OF THE INVENTION

[0003] Recently, digital cameras have become increasingly popular. Thesecameras normally operate by means of imaging a desired image utilizing acharge coupled device (CCD) array and storing the imaged scene on anelectronic storage medium for later down loading onto a computer systemfor subsequent manipulation and printing out. Normally, when utilizing acomputer system to print out an image, sophisticated software may beavailable to manipulate the image in accordance with requirements.

[0004] Unfortunately such systems require significant post processing ofa captured image and normally present the image in an orientation inwhich is was taken, relying on the post processing process to performany necessary or required modifications of the captured image.

SUMMARY OF THE INVENTION

[0005] It is an object of the present invention to provide a method forenhanced processing of images captured by a digital camera utilizingautofocus settings.

[0006] In accordance with a first aspect of the present invention thereis provided a method of generating a manipulated output image by meansof a digital camera, the method comprising the steps of:

[0007] capturing a focused image using an automatic focusing techniquegenerating focus settings;

[0008] generating a manipulated output image by applying a digital imagemanipulating process to the focused image, the digital imagemanipulating process utilizing the focus settings.

[0009] Preferably the focus settings include a current position of azoom motor of the digital camera.

[0010] In a preferred embodiment the digital image manipulating processincludes a step of locating an object within the focused image utilizingthe focus settings.

[0011] The method may include the step of printing out the manipulatedimage by means of a printing mechanism incorporated into the digitalcamera.

[0012] It is preferred that the digital image manipulating processselectively applies techniques to the focused image on the basis of thefocus settings.

[0013] In accordance with another aspect of the present invention thereis provided a method of generating an output image, in a digital camerathat includes an auto focus imaging system, the method comprising thesteps of:

[0014] capturing an image using the auto focus imaging system;

[0015] generating an output image by applying a digital imagemanipulating process to the captured image, the digital imagemanipulating process utilizing non image data generated by the autofocus imaging system.

[0016] In accordance with another aspect of the present invention thereis provided a digital camera that includes an auto focus imaging systemand an image processor, the image processor configured to:

[0017] receive an image captured using the auto focus imaging system;

[0018] receive non image data generated by the auto focus imagingsystem, and

[0019] to generate an output image by applying a digital imagemanipulating process to the captured image utilizing said non-imagedata.

[0020] The non-image data may include data relating to the position of azoom motor of the digital camera at the time the image was captured,data relating to the effective focal length of the lens system of thedigital camera at the time the image was captured and data relating todistance from the focal plane of the camera the auto focus imagingsystem was focused on at the time the image was captured.

[0021] The digital image manipulating process applied by the camera andmethod may include locating an object within the captured image.

[0022] The output image may be printed using a printing mechanisminbuilt into the digital camera.

[0023] The digital image manipulating process applied by the camera andmethod may selectively apply techniques to the captured image utilizingthe non-image data.

BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Notwithstanding any other forms which may fall within the scopeof the present invention, preferred forms of the invention will now bedescribed, by way of example only, with reference to the accompanyingdrawings in which:

[0025]FIG. 1 illustrates the method of the preferred embodiment; and

[0026]FIG. 2 illustrates a block diagram of the ARTCAM type camera.

DESCRIPTION OF PREFERRED AND OTHER EMBODIMENTS

[0027] The preferred embodiment is preferably implemented throughsuitable programming of a hand held camera device such as that describedin the concurrently filed application, applicant's reference ART01, U.S.Ser. No. 09/113,060 entitled “A Digital Camera with Image ProcessingCapability” filed concurrently herewith by the present applicant thecontent of which is hereby specifically incorporated by cross referenceand the details of which, and other related applications are set out inthe tables above and below. FIG. 2 shows a block diagram thereof.

[0028] The aforementioned patent specification discloses a camerasystem, hereinafter known as an “Artcam” type camera, wherein sensedimages can be directly printed out by an Artcam portable camera unitsuch as illustrated in FIG. 2. Further, the aforementioned specificationdiscloses means and methods for performing various manipulations onimages captured by the camera sensing device 30 leading to theproduction of various effects in any output image 40. The manipulationsare disclosed to be highly flexible in nature and can be implementedthrough the insertion into the Artcam of cards having encoded thereonvarious instructions for the manipulation of images, the cards 9hereinafter being known as Artcards. The Artcam further has significantonboard processing power by an Artcam Central Processor unit (ACP) 32which is interconnected to a memory device 34 for the storage ofimportant data and images.

[0029] In the preferred embodiment, autofocus is achieved by processingof a CCD data stream to ensure maximum contrast. Techniques fordetermining a focus position based on a CCD data stream are known. Forexample, reference is made to “The Encyclopedia of Photography” editorsLeslie Stroebel and Richard Zakia, published 1993 byButterworth-Heinemann and “Applied Photographic Optics” by London &Boston, Focal Press, 1988. These techniques primarily rely onmeasurements of contrast between adjacent pixels over portions of aninput image. The image is initially processed by the ACP 32 in order todetermine a correct autofocus setting.

[0030] This autofocus information is then utilized by the ACP 32 incertain modes, for example, when attempting to locate faces within theimage, as a guide to the likely size of any face within the image,thereby simplifying the face location process.

[0031] Turning now to FIG. 1, there is illustrated an example 1 of themethod utilized to determine likely image characteristics forexamination by a face detection algorithm 10.

[0032] Various images eg. 2, 3 and 4 are imaged by the camera device 28.As a by product of the operation of the auto-focusing the details of thefocusing settings of the autofocus unit 5 are stored by the ACP 32.Additionally, a current position of the zoom motor 38 is also utilisedas zoom setting 6. Both of these settings are determined by the ACP 32.Subsequently, the ACP 32 applies analysis techniques in heuristic system8 to the detected values before producing an output 29 having amagnitude corresponding to the likely depth location of objects ofinterest 21, 31, or 41 within the image 2, 3 or 4 respectively.

[0033] Next, the depth value is utilized in a face detection algorithm10 running on the ACP 32 in addition to the inputted sensed image 11 soas to locate objects within the image. An output 29 corresponding to aclose range value indicates a high probability of a portrait image, asin image 2, a medium range indicates a high probability of a groupphotograph as in image 3 and a higher range indicates a higherprobability of a landscape image as in image 4. This probabilityinformation can be utilized as an aid for the face detection algorithm10 and also can be utilized for selecting between various parameterswhen producing “painting” effects within the image 2, 3, or 4, orpainting the image with clip arts or the like, with differenttechniques, clip arts being applied depending on the distance to anobject.

[0034] It would be appreciated by a person skilled in the art thatnumerous variations and/or modifications may be made to the presentinvention as shown in the specific embodiment without departing from thespirit or scope of the invention as broadly described. The presentembodiment is, therefore, to be considered in all respects to beillustrative and not restrictive.

[0035] The present invention is further best utilized in the Artcamdevice, the details of which are set out in the following paragraphsalthough it is not restricted thereto.

[0036] Ink Jet Technologies

[0037] The embodiments of the invention use an ink jet printer typedevice. Of course many different devices could be used. Howeverpresently popular ink jet printing technologies are unlikely to besuitable.

[0038] The most significant problem with thermal ink jet is powerconsumption. This is approximately 100 times that required for highspeed, and stems from the energy-inefficient means of drop ejection.This involves the rapid boiling of water to produce a vapor bubble whichexpels the ink. Water has a very high heat capacity, and must besuperheated in thermal ink jet applications. This leads to an efficiencyof around 0.02%, from electricity input to drop momentum (and increasedsurface area) out.

[0039] The most significant problem with piezoelectric ink jet is sizeand cost. Piezoelectric crystals have a very small deflection atreasonable drive voltages, and therefore require a large area for eachnozzle. Also, each piezoelectric actuator must be connected to its drivecircuit on a separate substrate. This is not a significant problem atthe current limit of around 300 nozzles per print head, but is a majorimpediment to the fabrication of pagewidth print heads with 19,200nozzles.

[0040] Ideally, the ink jet technologies used meet the stringentrequirements of in-camera digital color printing and other high quality,high speed, low cost printing applications. To meet the requirements ofdigital photography, new ink jet technologies have been created. Thetarget features include:

[0041] low power (less than 10 Watts)

[0042] high resolution capability (1,600 dpi or more)

[0043] photographic quality output

[0044] low manufacturing cost

[0045] small size (pagewidth times minimum cross section)

[0046] high speed (<2 seconds per page).

[0047] All of these features can be met or exceeded by the ink jetsystems described below with differing levels of difficulty. Forty-fivedifferent ink jet technologies have been developed by the Assignee togive a wide range of choices for high volume manufacture. Thesetechnologies form part of separate applications assigned to the presentAssignee as set out in the table under the heading Cross References toRelated Applications.

[0048] The ink jet designs shown here are suitable for a wide range ofdigital printing systems, from battery powered one-time use digitalcameras, through to desktop and network printers, and through tocommercial printing systems

[0049] For ease of manufacture using standard process equipment, theprint head is designed to be a monolithic 0.5 micron CMOS chip with MEMSpost processing. For color photographic applications, the print head is100 mm long, with a width which depends upon the ink jet type. Thesmallest print head designed is IJ38, which is 0.35 mm wide, giving achip area of 35 square mm The print heads each contain 19,200 nozzlesplus data and control circuitry.

[0050] Ink is supplied to the back of the print head by injection moldedplastic ink channels. The molding requires 50 micron features, which canbe created using a lithographically micromachined insert in a standardinjection molding tool. Ink flows through holes etched through the waferto the nozzle chambers fabricated on the front surface of the wafer. Theprint head is connected to the camera circuitry by tape automatedbonding.

[0051] Tables of Drop-on-Demand Ink Jets

[0052] Eleven important characteristics of the fundamental operation ofindividual ink jet nozzles have been identified. These characteristicsare largely orthogonal, and so can be elucidated as an elevendimensional matrix. Most of the eleven axes of this matrix includeentries developed by the present assignee.

[0053] The following tables form the axes of an eleven dimensional tableof ink jet types.

[0054] Actuator mechanism (18 types)

[0055] Basic operation mode (7 types)

[0056] Auxiliary mechanism (8 types)

[0057] Actuator amplification or modification method (17 types)

[0058] Actuator motion (19 types)

[0059] Nozzle refill method (4 types)

[0060] Method of restricting back-flow through inlet (10 types)

[0061] Nozzle clearing method (9 types)

[0062] Nozzle plate construction (9 types)

[0063] Drop ejection direction (5 types)

[0064] Ink type (7 types)

[0065] The complete eleven dimensional table represented by these axescontains 36.9 billion possible configurations of ink jet nozzle. Whilenot all of the possible combinations result in a viable ink jettechnology, many million configurations are viable. It is clearlyimpractical to elucidate all of the possible configurations. Instead,certain ink jet types have been investigated in detail. These aredesignated IJ01 to IJ45 which match the docket numbers in the tableunder the heading Cross References to Related Applications.

[0066] Other ink jet configurations can readily be derived from theseforty-five examples by substituting alternative configurations along oneor more of the 11 axes. Most of the IJ01 to IJ45 examples can be madeinto ink jet print heads with characteristics superior to any currentlyavailable ink jet technology.

[0067] Where there are prior art examples known to the inventor, one ormore of these examples are listed in the examples column of the tablesbelow. The IJ01 to IJ45 series are also listed in the examples column.In some cases, a print technology may be listed more than once in atable, where it shares characteristics with more than one entry.

[0068] Suitable applications for the ink jet technologies include: Homeprinters, Office network printers, Short run digital printers,Commercial print systems, Fabric printers, Pocket printers, Internet WWWprinters, Video printers, Medical imaging, Wide format printers,Notebook PC printers, Fax machines, Industrial printing systems,Photocopiers, Photographic minilabs etc.

[0069] The information associated with the aforementioned 11 dimensionalmatrix are set out in the following tables. Description AdvantagesDisadvantages Examples ACTUATOR MECHANISM (APPLIED ONLY TO SELECTED INKDROPS) Thermal An electrothermal Large force High power Canon Bubblejetbubble heater heats the ink to generated Ink carrier limited to 1979Endo et al GB above boiling point, Simple construction water patent2,007,162 transferring significant No moving parts Low efficiency Xeroxheater-in-pit heat to the aqueous Fast operation High temperatures 1990Hawkins et al ink. A bubble Small chip area required USP 4,899,181nucleates and quickly required for actuator High mechanicalHewlett-Packard TIJ forms, expelling the stress 1982 Vaught et al ink.Unusual materials USP 4,490,728 The efficiency of the required processis low, with Large drive typically less than transistors 0.05% of theelectrical Cavitation causes energy being actuator failure transformedinto Kogation reduces kinetic energy of the bubble formation drop. Largeprint heads are difficult to fabricate Piezoelectric A piezoelectriccrystal Low power Very large area Kyser et al USP such as leadconsumption required for actuator 3,946,398 lanthanum zirconate Many inktypes can Difficult to integrate Zoltan USP (PZT) is electrically beused with electronics 3,683,212 activated, and either Fast operationHigh voltage drive 1973 Stemme USP expands, shears, or High efficiencytransistors required 3,747,120 bends to apply Full pagewidth print EpsonStylus pressure to the ink, heads impractical Tektronix ejecting drops.due to actuator size IJ04 Requires electrical poling in high fieldstrengths during manufacture Electrostrictive An electric field is Lowpower Low maximum Seiko Epson, Usui used to activate consumption strain(approx. et all JP 253401/96 electrostriction in Many ink types can0.01%) IJ04 relaxor materials such be used Large area required as leadlanthanum Low thermal for actuator due to zirconate titanate expansionlow strain (PLZT) or lead Electric field Response speed is magnesiumniobate strength required marginal (˜10 μs) (PMN). (approx. 3.5 V/μm)High voltage drive can be generated transistors required withoutdifficulty Full pagewidth print Does not require heads impracticalelectrical poling due to actuator size Ferroelectric An electric fieldis Low power Difficult to integrate IJ04 used to induce a phaseconsumption with electronics transition between the Many ink types canUnusual materials antiferroelectric (AFE) be used such as PLZSnT are andferroelectric (FE) Fast operation (<1 μs) required phase. PerovskiteRelatively high Actuators require a materials such as tin longitudinalstrain large area modified lead High efficiency lanthanum zirconateElectric field titanate (PLZSnT) strength of around 3 exhibit largestrains of V/μm can be readily up to 1% associated provided with the AFEto FE phase transition. Electrostatic Conductive plates are Low powerDifficult to operate IJ02, IJ04 plates separated by a consumptionelectrostatic devices compressible or fluid Many ink types can in anaqueous dielectric (usually air). be used environment Upon applicationof a Fast operation The electrostatic voltage, the plates actuator willattract each other and normally need to be displace ink, causingseparated from the drop ejection. The ink conductive plates may Verylarge area be in a comb or required to achieve honeycomb structure, highforces or stacked to increase High voltage drive the surface area andtransistors may be therefore the force. required Full pagewidth printheads are not competitive due to actuator size Electrostatic A strongelectric field Low current High voltage 1989 Saito et al, pull isapplied to the ink, consumption required USP 4,799,068 on ink whereuponLow temperature May be damaged by 1989 Miura et al, electrostaticattraction sparks due to air USP 4,810,954 accelerates the ink breakdownTone-jet towards the print Required field medium. strength increases asthe drop size decreases High voltage drive transistors requiredElectrostatic field attracts dust Permanent An electromagnet Low powerComplex fabrication IJ07, IJ10 magnet directly attracts a consumptionPermanent magnetic electromagnetic permanent magnet, Many ink types canmaterial such as displacing ink and be used Neodymium Iron causing dropejection. Fast operation Boron (NdFeB) Rare earth magnets Highefficiency required. with a field strength Easy extension from Highlocal currents around 1 Tesla can be single nozzles to required used.Examples are: pagewidth print Copper metalization Samarium Cobalt headsshould be used for (SaCo) and magnetic long materials in theelectromigration neodymium iron boron lifetime and low family (NdFeB,resistivity NdDyFeBNb, Pigmented inks are NdDyFeB, etc) usuallyinfeasible Operating temperature limited to the Curie temperature(around 540K) Soft A solenoid induced a Low power Complex fabricationIJ01, IJ05, IJ08, magnetic magnetic field in a soft consumptionMaterials not IJ10, IJ12, IJ14, core magnetic core or yoke Many inktypes can usually present in a IJ15, IJ17 electromagnetic fabricatedfrom a be used CMOS fab such as ferrous material such Fast operationNiFe, CoNiFe, or as electroplated iron High efficiency CoFe are requiredalloys such as CoNiFe Easy extension from High local currents [1], CoFe,or NiFe single nozzles to required alloys. Typically, the pagewidthprint Copper metalization soft magnetic material heads should be usedfor is in two parts, which long are normally held electromigration apartby a spring. lifetime and low When the solenoid is resistivity actuated,the two parts Electroplating is attract, displacing the required ink.High saturation flux density is required (2.0-2.1 T is achievable withCoNiFe [1]) Lorenz The Lorenz force Low power Force acts as a IJ06,IJ11, IJ13, force acting on a current consumption twisting motion IJ16carrying wire in a Many ink types can Typically, only a magnetic fieldis be used quarter of the utilized. Fast operation solenoid length Thisallows the High efficiency provides force in a magnetic field to be Easyextension from useful direction supplied externally to single nozzles toHigh local currents the print head, for pagewidth print required examplewith rare heads Copper metalization earth permanent should be used formagnets. long Only the current electromigration carrying wire need belifetime and low fabricated on the print- resistivity head, simplifyingPigmented inks are materials usually infeasible requirements. Magneto-The actuator uses the Many ink types can Force acts as a Fischenbeck,USP striction giant magnetostrictive be used twisting motion 4,032,929effect of materials Fast operation Unusual materials IJ25 such asTerfenol-D (an Easy extension from such as Terfenol-D alloy of terbium,single nozzles to are required dysprosium and iron pagewidth print Highlocal currents developed at the Naval heads required OrdnanceLaboratory, High force is Copper metalization hence Ter-Fe-NOL).available should be used for For best efficiency, the long actuatorshould be pre- electromigration stressed to approx. 8 MPa. lifetime andlow resistivity Pre-stressing may be required Surface Ink under positiveLow power Requires Silverbrook, EP tension pressure is held in aconsumption supplementary force 0771 658 A2 and reduction nozzle bysurface Simple construction to effect drop related patent tension. Thesurface No unusual separation applications tension of the ink ismaterials required in Requires special ink reduced below the fabricationsurfactants bubble threshold, High efficiency Speed may be causing theink to Easy extension from limited by surfactant egress from the singlenozzles to properties nozzle. pagewidth print heads Viscosity The inkviscosity is Simple construction Requires Silverbrook, EP reductionlocally reduced to No unusual supplementary force 0771 658 A2 and selectwhich drops are materials required in to effect drop related patent tobe ejected. A fabrication separation applications viscosity reductioncan Easy extension from Requires special ink be achieved single nozzlesto viscosity properties electrothermally with pagewidth print High speedis most inks, but special heads difficult to achieve inks can beengineered Requires oscillating for a 100:1 viscosity ink pressurereduction. A high temperature difference (typically 80 degrees) isrequired Acoustic An acoustic wave is Can operate without Complex drive1993 Hadimioglu et generated and a nozzle plate circuitry al, EUP550,192 focussed upon the Complex fabrication 1993 Elrod et al, dropejection region. Low efficiency EUP 572,220 Poor control of dropposition Poor control of drop volume Thermoelastic An actuator which Lowpower Efficient aqueous IJ03, IJ09, IJ17, bend relies upon differentialconsumption operation requires a IJ18, IJ19, IJ20, actuator thermalexpansion Many ink types can thermal insulator on IJ21, IJ22, IJ23, uponJoule heating is be used the hot side IJ24, IJ27, IJ28, used. Simpleplanar Corrosion IJ29, IJ30, IJ31, fabrication prevention can be IJ32,IJ33, IJ34, Small chip area difficult IJ35, IJ36, IJ37, required foreach Pigmented inks may IJ38, IJ39, IJ40, actuator be infeasible, asIJ41 Fast operation pigment particles High efficiency may jam the bendCMOS compatible actuator voltages and currents Standard MEMS processescan be used Easy extension from single nozzles to pagewidth print headsHigh CTE A material with a very High force can be Requires special IJ09,IJ17, IJ18, thermoelastic high coefficient of generated material (e.g.PTFE) IJ20, IJ21, IJ22, actuator thermal expansion Three methods ofRequires a PTFE IJ23, IJ24, IJ27, (CTE) such as PTFE deposition aredeposition process, IJ28, IJ29, IJ30, polytetrafluoroethylen underdevelopment: which is not yet IJ31, IJ42, IJ43, e (PTFE) is used. Aschemical vapor standard in ULSI IJ44 high CTE materials deposition(CVD), fabs are usually non- spin coating, and PTFE depositionconductive, a heater evaporation cannot be followed fabricated from aPTFE is a candidate with high conductive material is for low dielectrictemperature (above incorporated. A 50 μm constant insulation 350° C.)processing long PTFE bend in ULSI Pigmented inks may actuator with Verylow power be infeasible, as polysilicon heater and consumption pigmentparticles 15 mW power input Many ink types can may jam the bend canprovide 180 μN be used actuator force and 10 μm Simple planardeflection. Actuator fabrication motions include: Small chip area Bendrequired for each Push actuator Buckle Fast operation Rotate Highefficiency CMOS compatible voltages and currents Easy extension fromsingle nozzles to pagewidth print heads Conductive A polymer with a highHigh force can be Requires special IJ24 polymer coefficient of thermalgenerated materials thermoelastic expansion (such as Very low powerdevelopment (High actuator PTFE) is doped with consumption CTEconductive conducting substances Many ink types can polymer) to increaseits be used Requires a PTFE conductivity to about 3 Simple planardeposition process, orders of magnitude fabrication which is not yetbelow that of copper. Small chip area standard in ULSI The conductingrequired for each fabs polymer expands actuator PTFE deposition whenresistively Fast operation cannot be followed heated. High efficiencywith high Examples of CMOS compatible temperature (above conductingdopants voltages and 350° C.) processing include: currents Evaporationand Carbon nanotubes Easy extension from CVD deposition Metal fiberssingle nozzles to techniques cannot Conductive polymers pagewidth printbe used such as doped heads Pigmented inks may polythiophene beinfeasible, as Carbon granules pigment particles may jam the bendactuator Shape A shape memory alloy High force is Fatigue limits IJ26memory such as TiNi (also available (stresses maximum number alloy knownas Nitinol — of hundreds of MPa) of cycles Nickel Titanium alloy Largestrain is Low strain (1%) is developed at the Naval available (more thanrequired to extend Ordnance Laboratory) 3%) fatigue resistance isthermally switched High corrosion Cycle rate limited between its weakresistance by heat removal martensitic state and Simple constructionRequires unusual its high stiffness Easy extension from materials (TiNi)austenic state. The single nozzles to The latent heat of shape of theactuator pagewidth print transformation must in its martensitic stateheads be provided is deformed relative to Low voltage High current theaustenic shape. operation operation The shape change Requires pre-causes ejection of a stressing to distort drop. the martensitic stateLinear Linear magnetic Linear Magnetic Requires unusual IJ12 Magneticactuators include the actuators can be semiconductor Actuator LinearInduction constructed with materials such as Actuator (LIA), Linear highthrust, long soft magnetic alloys Permanent Magnet travel, and high(e.g. CoNiFe) Synchronous Actuator efficiency using Some varieties also(LPMSA), Linear planar require permanent Reluctance semiconductormagnetic materials Synchronous Actuator fabrication such as Neodymium(LRSA), Linear techniques iron boron (NdFeB) Switched Reluctance Longactuator travel Requires complex Actuator (LSRA), and is availablemulti-phase drive the Linear Stepper Medium force is circuitry Actuator(LSA). available High current Low voltage operation operation BASICOPERATION MODE Actuator This is the simplest Simple operation Droprepetition rate Thermal ink jet directly mode of operation: the Noexternal fields is usually limited to Piezoelectric ink jet pushes inkactuator directly required around 10 kHz. IJ01, IJ02, IJ03, suppliessufficient Satellite drops can However, this is not IJ04, IJ05, IJ06,kinetic energy to expel be avoided if drop fundamental to the IJ07,IJ09, IJ11, the drop. The drop velocity is less than method, but isIJ12, IJ14, IJ16, must have a sufficient 4 m/s related to the refillIJ20, IJ22, IJ23, velocity to overcome Can be efficient, method normallyIJ24, IJ25, IJ26, the surface tension. depending upon the used IJ27,IJ28, IJ29, actuator used All of the drop IJ30, IJ31, IJ32, kineticenergy must IJ33, IJ34, IJ35, be provided by the IJ36, IJ37, IJ38,actuator IJ39, IJ40, IJ41, Satellite drops IJ42, IJ43, IJ44 usually formif drop velocity is greater than 4.5 m/s Proximity The drops to be Verysimple print Requires close Silverbrook, EP printed are selected by headfabrication can proximity between 0771 658 A2 and some manner (e.g. beused the print head and related patent thermally induced The dropselection the print media or applications surface tension means does notneed transfer roller reduction of to provide the May require twopressurized ink). energy required to print heads printing Selected dropsare separate the drop alternate rows of the separated from the ink fromthe nozzle image in the nozzle by Monolithic color contact with theprint print heads are medium or a transfer difficult roller.Electrostatic The drops to be Very simple print Requires very highSilverbrook, EP pull printed are selected by head fabrication canelectrostatic field 0771 658 A2 and on ink some manner (e.g. be usedElectrostatic field related patent thermally induced The drop selectionfor small nozzle applications surface tension means does not need sizesis above air Tone-Jet reduction of to provide the breakdown pressurizedink). energy required to Electrostatic field Selected drops are separatethe drop may attract dust separated from the ink from the nozzle in thenozzle by a strong electric field. Magnetic The drops to be Very simpleprint Requires magnetic Silverbrook, EP pull on ink printed are selectedby head fabrication can ink 0771 658 A2 and some manner (e.g. be usedInk colors other than related patent thermally induced The dropselection black are difficult applications surface tension means doesnot need Requires very high reduction of to provide the magnetic fieldspressurized ink). energy required to Selected drops are separate thedrop separated from the ink from the nozzle in the nozzle by a strongmagnetic field acting on the magnetic ink. Shutter The actuator moves aHigh speed (>50 Moving parts are IJ13, IJ17, IJ21 shutter to block inkkHz) operation can required flow to the nozzle. The be achieved due toRequires ink ink pressure is pulsed reduced refill time pressuremodulator at a multiple of the Drop timing can be Friction and wear dropejection very accurate must be considered frequency. The actuator energyStiction is possible can be very low Shuttered The actuator moves aActuators with Moving parts are IJ08, IJ15, IJ18, grill shutter to blockink small travel can be required IJ19 flow through a grill to usedRequires ink the nozzle. The shutter Actuators with pressure modulatormovement need only small force can be Friction and wear be equal to thewidth used must be considered of the grill holes. High speed (>50Stiction is possible kHz) operation can be achieved Puls d A pulsedmagnetic Extremely low Requires an external IJ10 magnetic field attractsan ‘ink energy operation is pulsed magnetic pull on ink pusher’ at thedrop possible field pusher ejection frequency. An No heat dissipationRequires special actuator controls a problems materials for both catch,which prevents the actuator and the the ink pusher from ink pushermoving when a drop is Complex not to be ejected. construction AUXILIARYMECHANISM (APPLIED TO ALL NOZZLES) None The actuator directly Simplicityof Drop ejection Most ink jets, fires the ink drop, and constructionenergy must be including there is no external Simplicity of supplied bypiezoelectric and field or other operation individual nozzle thermalbubble. mechanism required. Small physical size actuator IJ01, IJ02,IJ03, IJ04, IJ05, IJ07, IJ09, IJ11, IJ12, IJ14, IJ20, IJ22, IJ23, IJ24,IJ25, IJ26, IJ27, IJ28, IJ29, IJ30, IJ31, IJ32, IJ33, IJ34, IJ35, IJ36,IJ37, IJ38, IJ39, IJ40, IJ41, IJ42, IJ43, IJ44 Oscillating The inkpressure Oscillating ink Requires external Silverbrook, EP inkoscillates, providing pressure can provide ink pressure 0771 658 A2 andpressure much of the drop a refill pulse, oscillator related patent(including ejection energy. The allowing higher Ink pressure phaseapplications acoustic actuator selects which operating speed andamplitude must IJ08, IJ13, IJ15, stimulation) drops are to be fired Theactuators may be carefully IJ17, IJ18, IJ19, by selectively operate withmuch controlled IJ21 blocking or enabling lower energy Acousticreflections nozzles. The ink Acoustic lenses can in the ink chamberpressure oscillation be used to focus the must be designed may beachieved by sound on the for vibrating the print nozzles head, orpreferably by an actuator in the ink supply. Media The print head is Lowpower Precision assembly Silverbrook, EP proximity placed in close Highaccuracy required 0771 658 A2 and proximity to the print Simple printhead Paper fibers may related patent medium. Selected construction causeproblems applications drops protrude from Cannot print on the print headfurther rough substrates than unselected drops, and contact the printmedium. The drop soaks into the medium fast enough to cause dropseparation. Transfer Drops are printed to a High accuracy BulkySilverbrook, EP roller transfer roller instead Wide range of printExpensive 0771 658 A2 and of straight to the print substrates can beComplex related patent medium. A transfer used construction applicationsroller can also be used Ink can be dried on Tektronix hot melt forproximity drop the transfer roller piezoelectric ink jet separation. Anyof the IJ series Electrotatic An electric field is Low power Fieldstrength Silverbrook, EP used to accelerate Simple print head requiredfor 0771 658 A2 and selected drops towards construction separation ofsmall related patent the print medium. drops is near or applicationsabove air Tone-Jet breakdown Direct A magnetic field is Low powerRequires magnetic Silverbrook, EP magnetic used to accelerate Simpleprint head ink 0771 658 A2 and field selected drops of constructionRequires strong related patent magnetic ink towards magnetic fieldapplications the print medium. Cross The print head is Does not requireRequires external IJ06, IJ16 magnetic placed in a constant magneticmaterials magnet field magnetic field. The to be integrated in Currentdensities Lorenz force in a the print head may be high, current carryingwire manufacturing resulting in is used to move the processelectromigration actuator. problems Pulsed A pulsed magnetic Very lowpower Complex print head IJ10 magnetic field is used to operation ispossible construction field cyclically attract a Small print headMagnetic materials paddle, which pushes size required in print on theink. A small head actuator moves a catch, which selectively prevents thepaddle from moving. ACTUATOR AMPLIFICATION OR MODIFICATION METHOD NoneNo actuator Operational Many actuator Thermal Bubble Ink mechanicalsimplicity mechanisms have jet amplification is used. insufficienttravel, IJ01, IJ02, IJ06, The actuator directly or insufficient force,IJ07, IJ16, IJ25, drives the drop to efficiently drive IJ26 ejectionprocess. the drop ejection process Differential An actuator materialProvides greater High stresses are Piezoelectric expansion expands moreon one travel in a reduced involved IJ03, IJ09, IJ17, bend side than onthe other. print head area Care must be taken IJ18, IJ19, IJ20, actuatorThe expansion may be that the materials do IJ21, IJ22, IJ23, thermal,piezoelectric, not delaminate IJ24, IJ27, IJ29, magnetostrictive, orResidual bend IJ30, IJ31, IJ32, other mechanism. The resulting from highIJ33, IJ34, IJ35, bend actuator converts temperature or high IJ36, IJ37,IJ38, a high force low travel stress during IJ39, IJ42, IJ43, actuatormechanism to formation IJ44 high travel, lower force mechanism.Transient A trilayer bend Very good High stresses are IJ40, IJ41 bendactuator where the two temperature stability involved actuator outsidelayers are High speed, as a Care must be taken identical. This cancelsnew drop can be that the materials do bend due to ambient fired beforeheat not delaminate temperature and dissipates residual stress. TheCancels residual actuator only responds stress of formation to transientheating of one side or the other. Reverse The actuator loads a Bettercoupling to Fabrication IJ05, IJ11 spring spring. When the the inkcomplexity actuator is turned off, High stress in the the springreleases. spring This can reverse the force/distance curve of theactuator to make it compatible with the force/time requirements of thedrop ejection. Actuator A series of thin Increased travel Increased Somepiezoelectric stack actuators are stacked. Reduced drive fabrication inkjets This can be voltage complexity IJ04 appropriate where Increasedpossibility actuators require high of short circuits due electric fieldstrength, to pinholes such as electrostatic and piezoelectric actuatorsMultiple Multiple smaller Increases the force Actuator forces may IJ12,IJ13, IJ18, actuators actuators are used available from an not addlinearly, IJ20, IJ22, IJ28, simultaneously to actuator reducingefficiency IJ42, IJ43 move the ink. Each Multiple actuators actuatorneed provide can be positioned to only a portion of the control ink flowforce required. accurately Linear A linear spring is used Matches lowtravel Requires print head IJ15 Spring to transform a motion actuatorwith higher area for the spring with small travel and travelrequirements high force into a Non-contact method longer travel, lowerof motion force motion. transformation Coiled A bend actuator isIncreases travel Generally restricted IJ17, IJ21, IJ34, actuator coiledto provide Reduces chip area to planar IJ35 greater travel in a Planarimplementations reduced chip area. implementations are due to extremerelatively easy to fabrication difficulty fabricate. in otherorientations. Flexure A bend actuator has a Simple means of Care must betaken IJ10, IJ19,IJ33 bend small region near the increasing travel ofnot to exceed the actuator fixture point, which a bend actuator elasticlimit in the flexes much more flexure area readily than the Stressdistribution is remainder of the very uneven actuator. The actuatorDifficult to flexing is effectively accurately model converted from anwith finite element even coiling to an analysis angular bend, resultingin greater travel of the actuator tip. Catch The actuator controls aVery low actuator Complex IJ10 small catch. The catch energyconstruction either enables or Very small actuator Requires externaldisables movement of size force an ink pusher that is Unsuitable forcontrolled in a bulk pigmented inks manner. Gears Gears can be used toLow force, low Moving parts are IJ13 increase travel at the travelactuators can required expense of duration. be used Several actuatorCircular gears, rack Can be fabricated cycles are required and pinion,ratchets, using standard More complex drive and other gearing surfaceMEMS electronics methods can be used. processes Complex constructionFriction, friction, and wear are possible Buckle A buckle plate can beVery fast movement Must stay within S. Hirata et al, “An plate used tochange a slow achievable elastic limits of the Ink-jet Head Usingactuator into a fast materials for long Diaphragm motion. It can alsodevice life Microactuator”, convert a high force, High stresses Proc.IEEE MEMS, low travel actuator involved Feb. 1996, pp 418-423. into ahigh travel, Generally high IJ18, IJ27 medium force motion. powerrequirement Tapered A tapered magnetic Linearizes the Complex IJ14magnetic pole can increase magnetic construction pole travel at theexpense force/distance curve of force. Lever A lever and fulcrum isMatches low travel High stress around IJ32, IJ36, IJ37 used to transforma actuator with higher the fulcrum motion with small travel requirementstravel and high force Fulcrum area has no into a motion with linearmovement, longer travel and and can be used for lower force. The lever afluid seal can also reverse the direction of travel. Rotary The actuatoris High mechanical Complex IJ28 impeller connected to a rotary advantageconstruction impeller. A small The ratio of force to Unsuitable forangular deflection of travel of the actuator pigmented inks the actuatorresults in can be matched to a rotation of the the nozzle impellervanes, which requirements by push the ink against varying the numberstationary vanes and of impeller vanes out of the nozzle. Acoustic Arefractive or No moving parts Large area required 1993 Hadimioglu etlens diffractive (e.g. zone Only relevant for al, EUP 550,192 plate)acoustic lens is acoustic ink jets 1993 Elrod et al, used to concentrateEUP 572,220 sound waves. Sharp A sharp point is used Simple constructionDifficult to fabricate Tone-jet conductive to concentrate an usingstandard VLSI point electrostatic field. processes for a surfaceejecting ink- jet Only relevant for electrostatic ink jets ACTUATORMOTION Volume The volume of the Simple construction High energy isHewlett-Packard expansion actuator changes, in the case of typicallyrequired to Thermal Ink jet pushing the ink in all thermal ink jetachieve volume Canon Bubblejet directions. expansion. This leads tothermal stress, cavitation, and kogation in thermal ink jetimplementations Linear, The actuator moves in Efficient coupling to Highfabrication IJ01, IJ02, 1J04, normal to a direction normal to ink dropsejected complexity may be IJ07, IJ11, IJ14 chip the print head surface.normal to the required to achieve surface The nozzle is typicallysurface perpendicular in the line of motion movement. Parallel to Theactuator moves Suitable for planar Fabrication IJ12, IJ13, IJ15, chipparallel to the print fabrication complexity IJ33, , IJ34, IJ35, surfacehead surface. Drop Friction IJ36 ejection may still be Stiction normalto the surface. Membrane An actuator with a The effective area ofFabrication 1982 Howkins USP push high force but small the actuatorcomplexity 4,459,601 area is used to push a becomes the Actuator sizestiff membrane that is membrane area Difficulty of in contact with theink. integration in a VLSI process Rotary The actuator causes Rotarylevers may Device complexity IJ05, IJ08, IJ13, the rotation of some beused to increase May have friction at IJ28 element, such a grill ortravel a pivot point impeller Small chip area requirements Bend Theactuator bends A very small change Requires the 1970 Kyser et al whenenergized. This in dimensions can actuator to be made USP 3,946,398 maybe due to be converted to a from at least two 1973 Stemme USPdifferential thermal large motion. distinct layers, or to 3,747,120expansion, have a thermal IJ03, IJ09, IJ10, piezoelectric differenceacross the IJ19, IJ23, IJ24, expansion, actuator IJ25, IJ29, IJ30,magnetostriction, or IJ31, IJ33, IJ34, other form of relative IJ35dimensional change. Swivel The actuator swivels Allows operationInefficient coupling IJ06 around a central pivot. where the net linearto the ink motion This motion is suitable force on the paddle wherethere are is zero opposite forces Small chip area applied to oppositerequirements sides of the paddle, e.g. Lorenz force. Straighten Theactuator is Can be used with Requires careful IJ26, IJ32 normally bent,and shape memory balance of stresses straightens when alloys where theto ensure that the energized. austenic phase is quiescent bend is planaraccurate Double The actuator bends in One actuator can be Difficult tomake IJ36, IJ37, IJ38 bend one direction when used to power two thedrops ejected by one element is nozzles. both bend directions energized,and bends Reduced chip size. identical. the other way when Not sensitiveto A small efficiency another element is ambient temperature losscompared to energized. equivalent single bend actuators. ShearEnergizing the Can increase the Not readily 1985 Fishbeck USP actuatorcauses a shear effective travel of applicable to other 4,584,590 motionin the actuator piezoelectric actuator material. actuators mechanismsRadial The actuator squeezes Relatively easy to High force required 1970Zoltan USP constriction an ink reservoir, fabricate single Inefficient3,683,212 forcing ink from a nozzles from glass Difficult to integrateconstricted nozzle. tubing as with VLSI macroscopic processes structuresCoil/ A coiled actuator Easy to fabricate as Difficult to fabricateIJ17, IJ21, IJ34, uncoil uncoils or coils more a planar VLSI fornon-planar IJ35 tightly. The motion of process devices the free end ofthe Small area required, Poor out-of-plane actuator ejects the ink.therefore low cost stiffness Bow The actuator bows (or Can increase theMaximum travel is IJ16, IJ18, IJ27 buckles) in the middle speed oftravel constrained when energized. Mechanically rigid High forcerequired Push-Pull Two actuators control The structure is Not readilysuitable IJ18 a shutter. One actuator pinned at both ends, for ink jetswhich pulls the shutter, and so has a high out-of- directly push the inkthe other pushes it. plane rigidity Curl A set of actuators curl Goodfluid flow to Design complexity IJ20, IJ42 inwards inwards to reduce thethe region behind volume of ink that the actuator they enclose.increases efficiency Curl A set of actuators curl Relatively simpleRelatively large IJ43 outwards outwards, pressurizing construction chiparea ink in a chamber surrounding the actuators, and expelling ink froma nozzle in the chamber. Iris Multiple vanes enclose High efficiencyHigh fabrication IJ22 a volume of ink. These Small chip area complexitysimultaneously rotate, Not suitable for reducing the volume pigmentedinks between the vanes. Acoustic The actuator vibrates The actuator canbe Large area required 1993 Hadimioglu et vibration at a high frequency.physically distant for efficient al, EUP 550,192 from the ink operationat useful 1993 Elrod et al, frequencies EUP 572,220 Acoustic couplingand crosstalk Complex drive circuitry Poor control of drop volume andposition None In various ink jet No moving parts Various otherSilverbrook, EP designs the actuator tradeoffs are 0771 658 A2 and doesnot move. required to related patent eliminate moving applications partsTone-jet NOZZLE REFILL METHOD Surface This is the normal way FabricationLow speed Thermal ink jet tension that ink jets are simplicity Surfacetension Piezoelectric ink jet refilled. After the Operational forcerelatively IJ01-IJ07, IJ10-IJ14, actuator is energized, simplicity smallcompared to IJ16, IJ20, IJ22-IJ45 it typically returns actuator forcerapidly to its normal Long refill time position. This rapid usuallydominates return sucks in air the total repetition through the nozzlerate opening. The ink surface tension at the nozzle then exerts a smallforce restoring the meniscus to a minimum area. This force refills thenozzle. Shuttered Ink to the nozzle High speed Requires common IJ08,IJ13, IJ15, oscillating chamber is provided at Low actuator ink pressureIJ17, IJ18, IJ19, ink a pressure that energy, as the oscillator IJ21pressure oscillates at twice the actuator need only May not be suitabledrop ejection open or close the for pigmented inks frequency. When ashutter, instead of drop is to be ejected, ejecting the ink drop theshutter is opened for 3 half cycles: drop ejection, actuator return, andrefill. The shutter is then closed to prevent the nozzle chamberemptying during the next negative pressure cycle. Refill After the mainHigh speed, as the Requires two IJ09 actuator actuator has ejected anozzle is actively independent drop a second (refill) refilled actuatorsper nozzle actuator is energized. The refill actuator pushes ink intothe nozzle chamber. The refill actuator returns slowly, to prevent itsreturn from emptying the chamber again. Positive The ink is held aslight High refill rate, Surface spill must Silverbrook, EP ink positivepressure. therefore a high be prevented 0771 658 A2 and pressure Afterthe ink drop is drop repetition rate Highly hydrophobic related patentejected, the nozzle is possible print head surfaces applications chamberfills quickly are required Alternative for:, as surface tension andIJ01-IJ07, IJ10-IJ14, ink pressure both IJ16, IJ20, IJ22-IJ45 operate torefill the nozzle. METHOD OF RESTRICTING BACK-FLOW THROUGH INLET Longinlet The ink inlet channel Design simplicity Restricts refill rateThermal ink jet channel to the nozzle chamber Operational May result ina Piezoelectric ink jet is made long and simplicity relatively largechip IJ42, IJ43 relatively narrow, Reduces crosstalk area relying onviscous Only partially drag to reduce inlet effective back-flow.Positive The ink is under a Drop selection and Requires a methodSilverbrook, EP ink positive pressure, so separation forces (such as anozzle 0771 658 A2 and pressure that in the quiescent can be reduced rimor effective related patent state some of the ink Fast refill timehydrophobizing, or applications drop already protrudes both) to preventPossible operation from the nozzle. flooding of the of the following:This reduces the ejection surface of IJ01-IJ07, IJ09-IJ12, pressure inthe nozzle the print head. IJ14, IJ16, chamber which is IJ20, IJ22,IJ23-IJ34, required to eject a IJ36-IJ41, certain volume of ink. IJ44The reduction in chamber pressure results in a reduction in ink pushedout through the inlet. Baffle One or more baffles The refill rate is notDesign complexity HP Thermal Ink Jet are placed in the inlet asrestricted as the May increase Tektronix ink flow. When the long inletmethod. fabrication piezoelectric ink jet actuator is energized, Reducescrosstalk complexity (e.g. the rapid ink Tektronix hot melt movementcreates Piezoelectric print eddies which restrict heads). the flowthrough the inlet. The slower refill process is unrestricted, and doesnot result in eddies. Flexible In this method recently Significantly Notapplicable to Canon flap disclosed by Canon, reduces back-flow most inkjet restricts the expanding actuator for edge-shooter configurationsinlet (bubble) pushes on a thermal ink jet Increased flexible flap thatdevices fabrication restricts the inlet. complexity Inelasticdeformation of polymer flap results in creep over extended use Inletfilter A filter is located Additional Restricts refill rate IJ04, IJ12,IJ24, between the ink inlet advantage of ink May result in IJ27, IJ29,IJ30 and the nozzle filtration complex chamber. The filter Ink filtermay be construction has a multitude of fabricated with no small holes orslots, additional process restricting ink flow. steps The filter alsoremoves particles which may block the nozzle. Small inlet The ink inletchannel Design simplicity Restricts refill rate IJ02, IJ37, IJ44compared to the nozzle chamber May result in a to nozzle has asubstantially relatively large chip smaller cross section area than thatof the nozzle, Only partially resulting in easier ink effective egressout of the nozzle than out of the inlet. Inlet A secondary actuatorIncreases speed of Requires separate IJ09 shutter controls the positionof the ink-jet print refill actuator and a shutter, closing off headoperation drive circuit the ink inlet when the main actuator isenergized. The inlet is The method avoids the Back-flow problem Requirescareful IJ01, IJ03, IJ05, located problem of inlet back- is eliminateddesign to minimize IJ06, IJ07, IJ10, behind the flow by arranging thethe negative IJ11, IJ14, IJ16, ink- ink-pushing surface of pressurebehind the IJ22, IJ23, IJ25, pushing the actuator between paddle IJ28,IJ31, IJ32, surface the inlet and the IJ33, IJ34, IJ35, nozzle. IJ36,IJ39, IJ40, IJ41 Part of the The actuator and a Significant Smallincrease in IJ07, IJ20, IJ26, actuator wall of the ink reductions inback- fabrication IJ38 moves to chamber are arranged flow can becomplexity shut off so that the motion of achieved the inlet theactuator closes off Compact designs the inlet. possible Nozzle In someconfigurations Ink back-flow None related to ink Silverbrook, EPactuator of ink jet, there is no problem is back-flow on 0771 658 A2 anddoes not expansion or eliminated actuation related patent result inmovement of an applications ink back- actuator which may Valve-jet flowcause ink back-flow Tone-jet through the inlet. NOZZLE CLEARING METHODNormal All of the nozzles are No added May not be Most ink jet systemsnozzle fired periodically, complexity on the sufficient to IJ01, IJ02,IJ03, firing before the ink has a print head displace dried ink IJ04,IJ05, IJ06, chance to dry. When IJ07, IJ09, IJ10, not in use the nozzlesIJ11, IJ12, IJ14, are sealed (capped) IJ16, IJ20, IJ22, against air.IJ23, IJ24, IJ25, The nozzle firing is IJ26, IJ27, IJ28, usuallyperformed IJ29, IJ30, IJ31, during a special IJ32, IJ33, IJ34, clearingcycle, after IJ36, IJ37, IJ38, first moving the print IJ39, IJ40, IJ41,head to a cleaning IJ42, IJ43, IJ44, station. IJ45 Extra In systemswhich heat Can be highly Requires higher Silverbrook, EP power to theink, but do not boil effective if the drive voltage for 0771 658 A2 andink heater it under normal heater is adjacent to clearing related patentsituations, nozzle the nozzle May require larger applications clearingcan be drive transistors achieved by over- powering the heater andboiling ink at the nozzle. Rapid The actuator is fired in Does notrequire Effectiveness May be used with: succession rapid succession. Inextra drive circuits depends IJ01, IJ02, IJ03, of some configurations,on the print head substantially upon IJ04, IJ05, IJ06, actuator this maycause heat Can be readily the configuration of IJ07, IJ09, IJ10, pulsesbuild-up at the nozzle controlled and the ink jet nozzle IJ11, IJ14,IJ16, which boils the ink, initiated by digital IJ20, IJ22, IJ23,clearing the nozzle. In logic IJ24, IJ25, IJ27, other situations, it mayIJ28, IJ29, IJ30, cause sufficient IJ31, IJ32, IJ33, vibrations todislodge IJ34, IJ36, IJ37, clogged nozzles. IJ38, IJ39, IJ40, IJ41,IJ42, IJ43, IJ44, IJ45 Extra Where an actuator is A simple solution Notsuitable where May be used with: power to not normally driven to whereapplicable there is a hard limit IJ03, IJ09, IJ16, ink the limit of itsmotion, to actuator IJ20, IJ23, IJ24, pushing nozzle clearing may bemovement IJ25, IJ27, IJ29, actuator assisted by providing IJ30, IJ31,IJ32, an enhanced drive IJ39, IJ40, IJ41, signal to the actuator. IJ42,IJ43, IJ44, IJ45 Acoustic An ultrasonic wave is A high nozzle High IJ08,IJ13, IJ15, resonance applied to the ink clearing capabilityimplementation cost IJ17, IJ18, IJ19, chamber. This wave is can beachieved if system does not IJ21 of an appropriate May be alreadyinclude an amplitude and implemented at very acoustic actuator frequencyto cause low cost in systems sufficient force at the which alreadynozzle to clear include acoustic blockages. This is actuators easiest toachieve if the ultrasonic wave is at a resonant frequency of the inkcavity. Nozzle A microfabricated Can clear severely AccurateSilverbrook, EP clearing plate is pushed against clogged nozzlesmechanical 0771 658 A2 and plate the nozzles. The plate alignment isrelated patent has a post for every required applications nozzle. A postmoves Moving parts are through each nozzle, required displacing driedink. There is risk of damage to the nozzles Accurate fabrication isrequired Ink The pressure of the ink May be effective Requires pressureMay be used with pressure is temporarily where other pump or other allIJ series ink jets pulse increased so that ink methods cannot bepressure actuator streams from all of the used Expensive nozzles. Thismay be Wasteful of ink used in conjunction with actuator energizing.Print head A flexible ‘blade’ is Effective for planar Difficult to useif Many ink jet wiper wiped across the print print head surfaces printhead surface is systems head surface. The Low cost non-planar or veryblade is usually fragile fabricated from a Requires flexible polymer,e.g. mechanical parts rubber or synthetic Blade can wear out elastomer.in high volume print systems Separate A separate heater is Can beeffective Fabrication Can be used with ink biling provided at the nozzlewhere other nozzle complexity many IJ series ink heater although thenormal clearing methods jets drop e-ection cannot be used mechanism doesnot Can be implemented require it. The heaters at no additional cost donot require in some ink jet individual drive configurations circuits, asmany nozzles can be cleared simultaneously, and no imaging is required.NOZZLE PLATE CONSTRUCTION Electro- A nozzle plate is Fabrication Hightemperatures Hewlett Packard formed separately fabricated simplicity andpressures are Thermal Ink jet nickel from electroformed required to bondnickel, and bonded to nozzle plate the print head chip. Minimumthickness constraints Differential thermal expansion Laser Individualnozzle No masks required Each hole must be Canon Bubblejet ablated orholes are ablated by an Can be quite fast individually formed 1988Sercel et al., drilled intense UV laser in a Some control over Specialequipment SPIE, Vol. 998 polymer nozzle plate, which is nozzle profileis required Excimer Beam typically a polymer possible Slow where thereApplications, pp. such as polyimide or Equipment required are manythousands 76-83 polysulphone is relatively low cost of nozzles per print1993 Watanabe et head al., USP 5,208,604 May produce thin burrs at exitholes Silicon A separate nozzle High accuracy is Two part K. Bean, IEEEmicro- plate is attainable construction Transactions on machinedmicromachined from High cost Electron Devices, single crystal silicon,Requires precision Vol. ED-25, No. 10, and bonded to the alignment 1978,pp 1185-1195 print head wafer. Nozzles may be Xerox 1990 clogged byadhesive Hawkins et al., USP 4,899,181 Glass Fine glass capillaries Noexpensive Very small nozzle 1970 Zoltan USP capillaries are drawn fromglass equipment required sizes are difficult to 3,683,212 tubing. Thismethod Simple to make form has been used for single nozzles Not suitedfor mass making individual production nozzles, but is difficult to usefor bulk manufacturing of print heads with thousands of nozzles.Monolithic, The nozzle plate is High accuracy (<1 μm) Requiressacrificial Silverbrook, EP surface deposited as a layer Monolithiclayer under the 0771 658 A2 and micro- using standard VLSI Low costnozzle plate to form related patent machined deposition techniques.Existing processes the nozzle chamber applications using VLSI Nozzlesare etched in can be used Surface may be IJ01, IJ02, IJ04, lith — thenozzle plate using fragile to the touch IJ11, IJ12, IJ17, graphic VLSIlithography and IJ18, IJ20, IJ22, processes etching. IJ24, IJ27, IJ28,IJ29, IJ30, IJ31, IJ32, IJ33, IJ34, IJ36, IJ37, IJ38, IJ39, IJ40, IJ41,IJ42, IJ43, IJ44 NOZZLE CLEARING METHOD Monolithic, The nozzle plate isa High accuracy (<1 μm) Requires long etch IJ03, IJ05, IJ06, etchedburied etch stop in the Monolithic times IJ07, IJ08, IJ09, throughwafer. Nozzle Low cost Requires a support IJ10, IJ13, IJ14, substratechambers are etched in No differential wafer IJ15, IJ16, IJ19, the frontof the wafer, expansion IJ21, IJ23, IJ25, and the wafer is IJ26 thinnedfrom the back side. Nozzles are then etched in the etch stop layer. Nonozzle Various methods have No nozzles to Difficult to control Ricoh1995 Sekiya plate been tried to eliminate become clogged drop positionet al USP 5,412,413 the nozzles entirely, to accurately 1993 Hadimiogluet prevent nozzle Crosstalk problems al EUP 550,192 clogging. These 1993Elrod et al include thermal bubble EUP 572,220 mechanisms and acousticlens mechanisms Trough Each drop ejector has Reduced Drop firing IJ35 atrough through manufacturing direction is sensitive which a paddlemoves. complexity to wicking. There is no nozzle Monolithic plate.Nozzle slit The elimination of No nozzles to Difficult to control 1989Saito et al instead of nozzle holes and become clogged drop position USP4,799,068 individual replacement by a slit accurately nozzlesencompassing many Crosstalk problems actuator positions reduces nozzleclogging, but increases crosstalk due to ink surface waves DROP EJECTIONDIRECTION Edge Ink flow is along the Simple construction Nozzles limitedto Canon Bubblejet (‘edge surface of the chip, No silicon etching edge1979 Endo et al GB shooter’) and ink drops are required High resolutionis patent 2,007,162 ejected from the chip Good heat sinking difficultXerox heater-in-pit edge. via substrate Fast color printing 1990 Hawkinset al Mechanically strong requires one print USP 4,899,181 Ease of chiphead per color Tone-jet handing Surface Ink flow is along the No bulksilicon Maximum ink flow Hewlett-Packard TIJ (‘roof surface of the chip,etching required is severely restricted 1982 Vaught et al shooter’) andink drops are Silicon can make an USP 4,490,728 ejected from the chipeffective heat sink IJ02, IJ11, IJ12, surface, normal to the Mechanicalstrength IJ20, IJ22 plane of the chip. Through Ink flow is through theHigh ink flow Requires bulk Silverbrook, EP chip, chip, and ink dropsare Suitable for silicon etching 0771 658 A2 and forward ejected fromthe front pagewidth print related patent (‘up surface of the chip. headsapplications shooter’) High nozzle packing IJ04, IJ17, IJ18, densitytherefore IJ24, IJ27-IJ45 low manufacturing cost Through Ink flow isthrough the High ink flow Requires wafer IJ01, IJ03, IJ05, chip, chip,and ink drops are Suitable for thinning IJ06, IJ07, IJ08, r verseejected from the rear pagewidth print Requires special IJ09,IJ10, IJ13,(‘down surface of the chip. heads handling during IJ14, IJ15, IJ16,shooter’) High nozzle packing manufacture IJ19, IJ21, IJ23, densitytherefore IJ25, IJ26 low manufacturing cost Through Ink flow is throughthe Suitable for Pagewidth print Epson Stylus actuator actuator, whichis not piezoelectric print heads require Tektronix hot melt fabricatedas part of heads several thousand piezoelectric ink jets the samesubstrate as connections to drive the drive transistors. circuits Cannotbe manufactured in standard CMOS fabs Complex assembly required INK TYPEAqueous, Water based ink which Environmentally Slow drying Most existingink dye typically contains: friendly Corrosive jets water, dye,surfactant, No odor Bleeds on paper All IJ series ink jets humectant,and May strikethrough Silverbrook, EP biocide. Cockles paper 0771 658 A2and Modern ink dyes have related patent high water-fastness,applications light fastness Aqueous, Water based ink whichEnvironmentally Slow drying IJ02, IJ04, IJ21, pigment typicallycontains: friendly Corrosive IJ26, IJ27, IJ30 water, pigment, No odorPigment may clog Silverbrook, EP surfactant, humectant, Reduced bleednozzles 0771 658 A2 and and biocide. Reduced wicking Pigment may clogrelated patent Pigments have an Reduced actuator applications advantagein reduced strikethrough mechanisms Piezoelectric ink- bleed, wickingand Cockles paper jets strikethrough. Thermal ink jets (with significantrestrictions) Methyl MEK is a highly Very fast drying Odorous All IJseries ink jets Ethyl volatile solvent used Prints on various FlammableKetone for industrial printing substrates such as (MEK) on difficultsurfaces metals and plastics such as aluminum cans. Alc hol Alcoholbased inks Fast drying Slight odor All IJ series ink jets (ethanol, canbe used where the Operates at sub- Flammable 2-butanol, printer mustoperate at freezing and temperatures below temperatures others) thefreezing point of Reduced paper water. An example of cockle this isin-camera Low cost consumer photographic printing. Phase The ink issolid at No drying time- ink High viscosity Tektronix hot melt changeroom temperature, and instantly freezes on Printed ink typicallypiezoelectric ink jets (hot melt) is melted in the print the printmedium has a ‘waxy’ feel 1989 Nowak USP head before jetting. Almost anyprint Printed pages may 4,820,346 Hot melt inks are medium can be used‘block’ All IJ series ink jets usually wax based, No paper cockle Inktemperature with a melting point occurs may be above the around 80° C.After No wicking occurs curie point of jetting the ink freezes No bleedoccurs permanent magnets almost instantly upon No strikethrough Inkheaters consume contacting the print occurs power medium or a transferLong warm-up time roller. Oil Oil based inks are High solubility Highviscosity: this All IJ series ink jets extensively used in medium forsome is a significant offset printing. They dyes limitation for use inhave advantages in Does not cockle ink jets, which improved paperusually require a characteristics on Does not wick low viscosity. Somepaper (especially no through paper short chain and wicking or cockle).multi-branched oils Oil soluble dies and have a sufficiently pigmentsare required. low viscosity. Slow drying Micro- A microemulsion is aStops ink bleed Viscosity higher All IJ series ink jets emulsion stable,self forming High dye solubility than water emulsion of oil, water,Water, oil, and Cost is slightly and surfactant. The amphiphilic solublehigher than water characteristic drop size dies can be used based ink isless than 100 nm, Can stabilize High surfactant and is determined bypigment concentration the preferred curvature suspensions required(around of the surfactant. 5%)

We claim:
 1. A method of generating an output image, in a digital camerathat includes an auto focus imaging system, the method comprising thesteps of: capturing an image using the auto focus imaging system;generating an output image by applying a digital image manipulatingprocess to the captured image, the digital image manipulating processutilizing non image data generated by the auto focus imaging system. 2.The method of claim 1, wherein the non-image data includes data relatingto the position of a zoom motor of the digital camera at the time theimage was captured.
 3. The method of claim 1, wherein the non-image dataincludes data relating to the effective focal length of the lens systemof the digital camera at the time the image was captured.
 4. The methodof claim 1, wherein the non-image data includes data relating todistance from the focal plane of the camera the auto focus imagingsystem was focused on at the time the image was captured.
 5. The methodof claim 1, including locating an object within the captured image. 6.The method of claim 1, further including printing out the output imageusing a printing mechanism inbuilt into the digital camera.
 7. Themethod of claim 1, wherein the digital image manipulating processselectively applies techniques to the captured image utilizing thenon-image data.
 8. A digital camera that includes an auto focus imagingsystem and an image processor, the image processor configured to:receive an image captured using the auto focus imaging system; receivenon image data generated by the auto focus imaging system, and togenerate an output image by applying a digital image manipulatingprocess to the captured image utilizing said non-image data.
 9. Thecamera of claim 8, wherein the non-image data includes data relating tothe position of a zoom motor of the digital camera at the time the imagewas captured.
 10. The camera of claim 8, wherein the non-image dataincludes data relating to the effective focal length of the lens systemof the digital camera at the time the image was captured.
 11. The cameraof claim 8, wherein the non-image data includes data relating todistance from the focal plane of the camera the auto focus imagingsystem was focused on at the time the image was captured.
 12. The cameraof claim 8, wherein the digital image manipulating process includeslocating an object within the captured image.
 13. The camera of claim 8,further including a printing mechanism.
 14. The camera of claim 8,wherein the digital image manipulating process selectively appliestechniques to the captured image utilizing the non-image data.